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IJTHODUCTION 



Use of social studies textbooks In the classroom has ^een ^ever^ely 
criticized, riving the inpresaion that textbooks may shortly cease being 
used* Yet few of the critics have felt compelled to make a careful and 
relevant analysis of the objects they are denouncing.^ Moreover, social 
studies textbooks utill seem to hold a prominent place in the American 
school scene and, as P^^lner^ noted, it is difficult to locate a social 
studies classroom that functions \flthout a textbook* 

Some classroom teachers use the textbook as an essential teaching 
tool, but in too many classrooms the social studies textbook is the 
social studiesr curriculum* \7hen one recocnizes that, as Doui:lass^ observed, 
most elementarj- school teachers are not directly prepared to teach the sub- 
ject natter they are expected to cover, there is little wonder that the 
textbook dominates classroom procedures, both in the selection of content 
to be covered and in guiding the teacher's selection of learning activities • 



1. "Views and Previews," Social Bducation j 33: , iJo. 3, March, 

1969. ; 

2« John ft* Palner, "Selection and \Use of Textbooks and Audio-Visual 
Materials," New Challenges in the Socia^ Studies^ Byron G« Massialas and 
Frederick R. Smith, editors (Belmont, Calif orniat Wadsworth Publishing Co., 
196^), p. 156. 

3» Malcolm P. Douglass,* Social Studies From Theory to Practice in 
Elementary Education, (New York: J.B. Lippincott Co., 1967), p. 52. 
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Social Education devoted the entire Ikwch 1969 issue to sorirl studies 
texLbooke* Headers were asked to vote on the questioni "Should iiC^^ £valu* 
ate Textbooks?" The basic premise underlyinf; this question was the observ- 
ation by John Ohles^ that inexpert and prejudiced pronouncements on instruc- 
tion or textbooks can l>e countered r^^ectivoly o aly by export,- u-nijiacedi and 
professional evaluation* Only throuf^h co^niz^ince of the textbooks prominent 
role in the social studies curriculuri, can educators bej;in to remedy the pliant 
of the highly criticized, yet widely utiliz'^d social studies textbook. 

The textbook can croate images that may be valid or invalid, depending 
on what information is presented and how it is presented. Tlierefore it is 
important that the content presented is adequately and accurately developed* 
Objective analysis and evaluation of texcbiok content by scholarly ex:>Grts 
further help develop satisfactory textbooks. In this paper, therefore, a 
model of social studies textbook analysis and evaluation is developed. The 
model is ai^plied, as an example, to the analysis and evaluation of the con- 
tent on Hawaii in selected elementary school social studies textbooks* 

Hawaii is our miilti-* racial state, wtiere all racial groups hannoniously 
participate in the political, economic, and social life of the community. 
It is also our strategic militan'' and commercial outpost between Asia and 
the continental United States* An increasing number of people are inter- 
ested in Hawaii as a vacation site* However, most Americans learn about 
Hawaii through seconuary sources of information, for example, travel adver- 
tisements, television^ and movies. The elementary school child usually 
studies about Hawaii through social studies textbooks that present varying 



1. John OJdes, "Should MOSS Evaluate Textbooks?", Socla? Education t 
33i321, March, 1969. 

ERLC 



levels of information on the flubjectt As the results of the analysis and. 
evaluation below indicate^ the social studies textbooks often do not ade-» 
quately or accurately present the realities of Hawaiit Therefore, the 
social studies textbook content on iiawaii appears to be particularly appro** 
priate for analysis and evaluation* 

PHOCED^nffiS 

Identification and Collection of Textual Content 

The textual content on Hawaii in selected social studies textbooks 
was identified and collected« It was decided to limit the study to thirtj- 
one textbooks published between 1955 and 1970, and designated for trades 
four, five, and six, where the bulk of the textbook material on Hawaii is 
centered* 

The selected textbooks were first grouped by ^^rade level and coded 
in the orc'er of the amount of information presented* The content compiled 
from each of the textbooks was then examined paragraph by paragraph, and 
divided into recording units * In this study a recording unit is composed 
of a number of sentences from one. or more paragraphs that sufficiently 
elucidate a definite idea or concept on the subject* 
Categorization of the Recording Units 

Categories differentiate and describe the content being investigated, 
and also define the limits of the aggregate of material being analyzed* 
After s' udying various possibilities, it was decided to capitalize on the 
category systems used in the Stanford Project directed by Dr* Paul Hanna. 
The Stanford Project provided the following two category systems to clas- 
sify the content on Hawaii found in the social studies textbooks* 



I, Basic Kunian Acbivities . The basic activities of man can be used 
as tiie bcisis of the Lsocial studies curriculum, Hanna described the scops 
of the social studies; curriculum in .-these terms: ."The scope is concernecl 
^dth the vrfiat of^^j^the curriculum. The scope is defined as the basic hunan 
activities tl-rough v:bich nen have riet their aoeds and ^-clvcd th:;ir pror^lcrij:: 
r^risini;^, fron ricui-to-'nian rolabions in vsocial, economic, and ,r)litic;al scl- 
tMiK^^*"''' H?nn<\ expvQ)SivyA the view that tlie basic huhan activities cate[:ories 
Here universal in all societies, , regardlevSS of tine or location. 

The nine subcategories of the basic huraan activities are presented 
> below with- examples of recording units of the textual content on Havjrnii^ 
gleaned from the social .studies textbooks examined • 



Protecting and Conserving Human and IJatural Resources and Property — 
Today vie know it is not easy for people to get leprosy. Doctors 
know hovj to cure people who have it. The hospital on I-'l oloka i . 
no longer has many patients. Years ai^o^ people did not vdsh 
to visit Molokai because they vere afraid of getting leprosy* 

Producing^ Exchanging ^ Distributing ^ and Consuiaing Food ^ Clothing ^ 
Shelter ^ . and Other Consumer Goods and Sc^r vices . — The first 
Kawaiians had no metal or pottery. So tools, cooking utensil-s, 
and even houses were made from wood^ stone, shells^ or leaves. 

Transporting; People and Goods — VJhen Polynesians were looking for 
a new home, 'the canoes v:ere crowded with carefully selected 
people pigs, chickens, dogs, food, seeds ^ cuttings of plants, 
imtevy fishing equipment, and tools. 

Coramainicating Ideas and Feelings — The early Hav/aiians had no 

schools or libraries, in which to learn about the. outside world,- 
They had no written language. 



1. Paul Hanna, ^'Content in the Social Studies," John Michaelies 
(ed.). Social Studies in Elementary Schools ,' Washington: National 
Council fvor the Social Studies^ 1?62, p. 69, 
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Providing Education — Missionaries fron the United States- had great 
influence in Hawaii^ beyond teaching En^jlish. and. the Christian 
relicion to the people^ They learned the Hai^aiian language and 
. taurrht the people to read and vrrite it; usin?- ti^elve lettor.s from' 
the. English alphabet. 

Providin[^ Recreatio n In winter you my enjoy skiing; on the slopes 
of Kauna Kea. • • - ■ 

Orranxzini; and Governing — Kings ruled the Hawaiian .Islands at the 
time of Captain Cook and. earlier. They were often .at war with 
one another. 

Creating Tools, Technics j and Social Arrangeraents — Hawaiians hung 
a lei^ a vjreath of flovjers around a departing visitor's neck^ 
which meant they would be happy to have him come a^^ain. 

Expressing and Satisf yin^r s Aesthetic and Spiritual Impulses ' — The " 
people were kind and getierous in. their daily lives but their 
religion often included such sava^^e customs as human sacrifice • 

' Most of the textbooks used in the current study presented both a his- 
torical background of the Hawaiian Islands and a \ievf of modern Haviaii. 
Since old and modern Hawaii are two completely different societies^ the J 
decision uas made to further arnplify the category^ systeirj of the basic ac- 
tivitiea of ifian 'by differentiating between the past and the present s 

II. Factors in the Natural Environments The factors in the natural 



environment are adapted from the following sixteen descriptive elements 
identified by Renner-^^ and utilized in the Stanford. Project 



Physical ^ . ■ 
Soils ■ 

" Atmosphere (vjeather and clirnate), 

Surface- water features 

Underground waters 
.. . Rocks and minerals 

Landrorms , 

Littorals (coast lines, harbors^ etc.)- 
• ■ • The o'ceans 



George Renner, et al. j World . Economic Geography '(Mev/ York: Crowell^. 
. , 1951)/ p. 20, 

i-nrr>" 2V Ibid., p.: 19* : 
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Biotic 

- Natural ve^atation 
Uf.tivo animal lifo 
[iicro-orf'anisma. 

Spatial 

Spaco or^arca iiefional form Gloual position 

Natural situation ilelativo location 

Modification of the Qatefory Systems 

As various nethcds of collecting and catufrorli^inf': the content on 
Hawaii were experimented vath, it became obvious* that two modifications 
had to be riCide in the catefory systepis* The textual presentations dealt 
\d.th two unique features about Hav/aii, the people of iiawaii and the fact 
that/Iawaii is an archipelaco conorisinp; of eif^ht rajor islarida. rlany of 
t;ie textbooks presented inforuation aboait the people, without reference 
to any of their basic hman activities. Ilany texi/books also presented 
inf orriation at. out the uniqueness of each of the ei^^ht islands. For complete 
coverafe of the texl^book presentations on Hawaii ^ it was thus necessary to 
add a category entitled People > referring to the population of Hawaii, and 
a caterory entitled Islands ^ which named the eifht major Hawaiian Islands* 
Synthesis of the Recording Units 

After all the recordinK vmits of the textual content were categorized 
under the subcategories, those recording units that elucidated the same 
concepts about Hawaii were synthesized by combining them. The recording 
units with the most obvious agreement were easily synthesized leaving the 
less obvious material to be reconsidered. In this manner, the material wits 
constantly reread, regrouped, and reclassified until it was reduced to the 
smallest number of discrete statements reflecting basically the same con- 
cepts or ide-is that constituted synthesized units. 
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The original recording units gleaned from the thirty-one social studies 
textbooks for all of the major category syotoms totaled 9^0% ^fter aynthu- 
slztnp the conparable rocordinR units, a total of 286 synthesized units woro 
identified. 

Establishment of Intercoder iteliability 

In content analysis, the researcher is nainly concerned with investi- 
gating the existing state of the content communic;ated. To ascertain objec- 
tivity in the content analyzeoy reliability test ahould also be a^jplied* 
rieliability can be moauureu by rinding out if other persona, usinf the t^ame 
techniques on the satn^^ material, will i^et substantially the name results • 
Two impartial coders were a^ked to read all of the recording units to con- 
firm or reject the decisions of the researcher in synthesizing and cate- 
gorizing the textual content* An intercoder reliability pcrcenta^'e (liiP) 
between the coders and the researcher was established byj 

IRP » .^ber of Units Agreed Upon 

X 100 

iotal liumber of Units 

Intercoder reliability on the synthesis of the recording units into 

the synthesized units was tested 'n the following three steps: 

First Step s Cod^ i read all of the recording units as well as the 

synthesizea units, then agreed or disagreed with the researcher's 

synthesis* ^ 

Second Step ? For those synthesized units upon which disagreements 

arose in the first step, both coders made suggestions for a dif- 
ferent wording of the synthesized units, or investigated the 
original textual material to make suggestions* i^fter discussing 

ERLC 
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the disaf reements, the coders and U\o resaarcher were able to 
agree on some of the units previously disaj^reed upon* 

Third Step i If disarreements persisted oven in the sjecond step, 
those units disagreed upon were separated, and the original 
textual content was again reviewed in the lij^ht of the coders* 
expressed views, and final decisions were made by the researcher* 

The intercodcr reliability percentafes in the synthesis of the tex- 
tual content between the two coders and the researcher were the following i 

First Coder Second Coder 

First Step 90% 67% 

Second Step 7% 13i 

Third Step 3% 

Intercoder reliability on the catecorization of the textual content 
was tested in the follo^dng two steps: 

First Step : iiach of the coders independently analyzed all of the 
synthesized units and re-sorted them under the subcate£:ories j 
then each coder and the researcher coirqpared categorized units • 

Second Step ? For those categorized units on which disagreements 
arose in the first step, each person presented this rationale 
for placing the units in the particular subcategory^ After 
discussing the differences, the coders and the researcher tried 
to reach agreement on the units previously disagreed upon* 

The intercoder reliability percentages in the categorization process 
between the two coders and the researcher were the following: 

First Coder Second Coder 

First Step : 92*5^ $6% 

Second Step : 7 #5;^ 
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The coders and the researcher thus reached conplete apreement ty the 
SGCond step of comparison* Such high reliability resulted rrom the sim- 
plicity of the categories used in uho prestfnt study* 
Constructjpg p of Lry <j| gstionnaire 

A questionnaire conprisiag the synthc^si/.^d units on Hawaii, (now 
identified as o^uestionnairc units ; was ths instr;junent usad to collect data 
to answer the najor question raised in this studj% The questionnaire was 
decided upon as the nost appropriate Instrurient for fathering the data* 
Van Dalen"^, for instance, supported the use of the questionnaire by noting 
that, for sone r^tudies or certain phases of then, it may be the only prac- 
tical device available for presenting; respondents with carefully selected 
and ordered stimuli that will elicit the, data required to confirm or deny 
a hypothesis. 

The questionnaire developed in this study was constructed with the 
^dew of making it possible to collect data that would appraise both the 
accuracy and the degree of importance of the textual content presentation^ 
The questionnaire also provided space for juror's comments. Finally^ the 
questionnaire needed to lend itself to whatever statistical treatment and 
descriptive analysis tnat might be applicable in the interpretation of the 
data collected. For example, adequacy was determined, as shown below, by 
combining the data pertaining to the accuracy and importance of the textual 
content • , 

In order to trace each questionnaire unit back to the original text- 
book recording unit from wKlcH the qu3stionnaire unit was synthesized, code 
nxunbers of the original textbooks were listed next to the questionnaire units. 

1* Deobold D, Van Dalen, Understanding Educational Rese<>trchj (New York* 
McGraw-Hill), 1962, p. ZSk* " 

O 
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The question'^airei containiaR 266 questionnaire units^ was divided 
into three rectAonsj l»e», (1) Basic Human Activities, Past ! (2) Basic 
Human Activities, Present i and (3) Factors in the Natural Environment 
(which included the additional subcatef-ories of People and Islands) • 
Selection of the Jury llerabers and Their Appraisal of the Questionnaire 

A ^xxry of twelve scholars at the liniversitjr of Hawaii was asked to 
participate in the study. Many of then were !!awaiiana scholars w^jo taught 
courses on Ha;<aii# Ohles''' supported the c^'^ntributions of scholrjrs to the 
improvement of textbooks, b^ observing; that, despite the expertise of 
writers and publishers, many unnecessary errors find their way into text- 
books. Fa'jtual accuracy can be best determined by the most recent state 
of a discipline and interpretations by the consensus of experts. 

Tl^xe twelve jury members were divided into three groups, each froup 
composed of four individuals. Members of each proup then individually 
appraised the same questionnaire units beloof^ing to one of the three sec- 
tions of the questionnaire. The appraisal by the jury was performed by 
checking the appropriate column provided in the questionnaire to indicate 
whether each unit wast 

(1) Accurate or Inaccurate 

(2) Important 

(a) Highly Imgortant~essentiax to understand Hawaii, or 

(b) Ifoderately Important ^^desirable for understanding, but 
not essential, or 

(c) Unimportaat^ ^unnecessary to understand Hawaii. 
A column was also provided for comments by the jury members. 



O . . !• Ohles, 0£. cit., 322 



QUANTITATIVE EVALUATIUN 0"^ THS 
T£Xrm JOMTSi^ 

^ quantitativt evmluation of tht pr^eeatatloM on Hawaii in th« 
■alactad sooial atudiaa taxtbooka was mda primarily b/ uaing tha Jury* a 
ai^praiaal of tha aynthaai^ad taxtual contant^ i*o*9 questionnaire units* 
Nqw mathoda of taxtboolc content analyaia vara introduced to determine aa 
maqy aaaaaananta aa poaaibla of tha data collected* 
Th^ Peroentage of the Textual Content 

The relative peroentaf ea of the textual content on Hawaii in the 
aelectad Alenentaiy social studies textbooks were determined by the line 
counting nethodf to determine whether aufficient space was devoted to the 
presentation on Hawaii • 

The averafre percentace of lines relating to Hawaii for thp fourth^ 
fifths and aixth grade textbooka are^ respectively ^ 2*52jif l•35^ and Ot83^. 
The overall average textbook coverage parcentace on Hawaii was 1*58^ These 
peroentagea oonpar* twonbly with tha percentagea of 2%^ 0O8^f and 0*16j(t 
reapeotlvaljrf lif the nuMber of atates^ population (1970 Cenaua)^ and area 
in Hawell^againat thoae of the total In the United SUtea# Although auch 
perooQtagt indleatora netd not neoeaaarlXy diotate the percentage of the 
textual oontent on Hawaii^ it appeara that the aelected elamntary aoeial 
atudlaa taxtbooka in gaoaral gave aatiafactory attention to Hawaii* 
Junr>a Appraiaal ^ Qtteatiopnalre Pnita and Ita Application t£ the 
AppralaaX of tha Ttotbooka 

The prlMry taak of this atudtf waa to deteraine quantitatively tha 
aeoara^ and iKportanoa of the taxtual imaentationa on Hawaii^ aa revealed 



1« The \iarld Alawiaet 1972, Maw^Mtpar Intarprlipf Aaaoo.^ Znc» 
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by the appraisal of the questionnaire units by the jury members. The 
adequacy or ••acceptability" of the textual content was also detem;ined» 

In o^der to quantify the jury'c a. praieal reeardinp the accuracy 
and importance of the nuestionnairo^ each juror's appraisal was weiEhtod 
by numerical values* Since inaccurato textual content ccatributes to 
nisunderstaadini's and the development of erroneous concepts by students, 
a questionnaire unit that was appraised inaccurate was wcishted -lOOj 
w^ile the accurate recording: unit was weighted ^100 % The weighted accuracy 
point of a queationnaire unit averaged for* all four jury members thus 
ranged beti^reen -100 and +100, moving from the negative to the positive as 
accuracy improved* The zero weighted accurapy point indicated a midpoint 
accuracy in the jury's consensus, and the positive or negative weighted 
accuracy points, -esoectively, indicated that the queationnaire unit was 
relatively accurate or inaccurate* 

Unimportant textual content may waste textual space that co\xld other* 
wise be more productively utilized, but it may not create student misunder- 
standings* Therefore, an uplmportant questionnaire unit was weighted by 
zeroM while moderately and highly Important questionnaire units were, 
respectively, weighted bjy ^ and IjOO^ The weighted Importance point of a 
questionnaire unit averaged for all four jury members thus was always non- 
negatlvei, ranging -from 0 to 100* 

By so determining the accuracy and Importance with numbers ranging 
(«100 to ♦loo) aiKl (0 to loo), respectively. It was possible to develop 
the concept of • •Acceptability " of the textual qxiestlonoalre unit ast 

(AccepUbillty) • t^/Kvielghted Accnrapy)) X (Weighted Importance) 
Point f I Point I Pt>lnt 

ERLC 
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whore the sicnc •••or - wore to bo laken deperuiirif on whether the wciL'hted ■ 
accuracy point was positive or ae^^ative. 

;sote that the aocopLability for the troatrient of a highly inportant 
(InportancR lOO) questionnaire unit with hip;h accuracy (Accuracy •♦•lOO) is 
•••ICXJ, while the trefcitment of a hiplily important ^ juestionnaire unit with 
high inaccuracy (Accu;-acy -100) is -100. This neano that th3 hi^-hly accurate 
treatment of a hiphly important item is highly accop table (Accopta bilit^ ••^lOO), 
while the highly inaccurate treatment of a nipiily inportant item may create 
misunderstandings of essential concepts by students, and therefore is highly 
unacceptable (Acceptability -100 )♦ Moderate acceptability results for the 
moderately accurate treatment, of the highly inportant iteias, and also in 
general for the treatment of moderately important items 

The jury's average weighted points of the questionnaire units in ^^ach 
of the three major ca.teEories (Natural Environment, Past rJasiu Hunan Activ- 
ities and Present Basic Human Activities) for Accuracy, Important, and 
Acceptability were determined by adding the weighted points of all of the 
questionnaire units in each of the major categories and dividing t^9m by 
the total number of questionnaire units in the major categories. The jury^s 
average weighted points were also determined for all of the three major 
categories, combined* The resxilts of the jury's average weighted points of 
the questionnaire units are given in Table I (a)» 

1» Note that Acceptability is zero when either the weighted Accuracy 
or Importance is zero. -This may be avoided by modifying the formula intro- 
duced in this study for Acceptability* However, the occurrence of the zero 
weighted accuracy and iir5)ortance actually obtained from the jury's appraisal 
was not frequent, and the formula introduced in this stiidy for Acceptability 
Q -erved its desired purposes* 
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The roseGTcher also rade an Inuependeiit (^valuation of all the quosticm- 
naire units to conpare her anpralsal ^"dth the jury'st The queatlonnaire 
units were indiviJaally r'^ri^>'irched, and quotations from vari'jus referraces 
were v;ritten domi Lo subutantiato or refute the accuracy or inaccuracy of 
the unitf^. The r^^s^^archer used her jud^iiGnt in cieterr iniu:; the iriijortance 
of each unit by ^akia(; into rjon.sider-^ tion tho following; factorsj 

!• Ihe a^'uount of space set aside by the textbooks on Mawaii is lim- 
ited; consequently, the most essential information sho\ild have 
creference over less ir.portant information^ 

2. The information children should know about }{avmii# 
The results of the researcher ' ;:i appraisal of the questionnaire units are 
presented in Table I (B). 

Table I (A,F) reveal that in both the jury's and researcher's ap- 
praisals of the textual content, the Present Basic Hxoman Activities cate- 
gory was most accurately treated, while the Past Basic Human Activities 
category was treated least accurately^ This contrasted narkedly with the 
greater degree of success accomplished in treating important content re- 
lating to the Past Basic Human Activities. 
(Quantitative Appraisal of the Individual Textbooks . 

The quantitative evaluation of the jury's appraisal thus far has been 
concerned with the questionnaire as a whole* The questionnaire was composed 
of the synthesized recording units gleaned from the thirty-one social studies 
textbooks. However # in most elementary school classrooms, individual text- 
books are used in the actual teaching of social studies. Therefore the 
quantitative evaluation of each lndlvid\ial textbook selected for investi- 
gation in this study was necessary* 
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3y reviewiaK the code riu^ibers of the textbooks listed next tu the 
queatioanalre urdts, it was possible to revert to the orif^inal textbookc 
to detornins the original sources of the nrta::tionnaire unit. In tliis 
manner, all of the synthesized questionnaire units ^rere traced back t'j 
the individual textbook* The jury's appraisal data on Accuracy^ Impor- 
tance, and Acceptability were then collected for r;ll reccrdin^; units from 
the individ^oal toxtbook. 

The number of recording units and the total wGi^:hted jury's appraisal 
points of tnese recording units for Accuracy, Importance, and Acceptability 
were gathered for each major category for the individual textbook* By 
using the data, the average Accuracy, Importance, and Acceptability point^s 
for the individual textbooks were calculated according to the major cate- 
gories* The average Accuracy, Importance, and Acqeptal?ility for the text- 
books on each grade level i/ere then calculated, and the results are given 
in Table II. In Table II, the column of "liixed Grade" indicates the aver- 
age of the textbooks that simultaneously cover grades (4j5) and (Uj5>6)« 
Finally, the averages of all the textbooks investigated in this study are 
given in the last column of Table II* 

An interesting finding noted In Table 11 is that the textbooks on 
the average treated content in the Present Basic Human Activities Category 
most accurately (Overall "Accuracy +55«U)> in agreement with the results 
obtained from the jury's appraisal of the questionnaire units without 
actually referring back to the individual textbooks. However, the text- 
books on the average treated content in the Factors in the Natural Envi- 
ronment category least accurately (Overall Accuracy +30.6). This result 
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contrasts vdth the result obtained abo\^e fron t le jury^s appraisal of 
the questionnaire, where the least accuraL' ly prefrented major category 
was Past Basic Hunan Activities • However, such results are not contra- 
dictory! because the questionnaire as a whole does not necessarily reflect 
how the Individual textbook is actually writtent The results of the evalu- 
ation of the questionnaire itself, which was developed by eliminating repe- 
tition by synthesizing the individual textbook content, can deviate from 
the average of the individual textbook content evaluation, where the repe- 
tition of the same content by different textbooks is properly taken into 
account* 

In regard to Importance, the textbooks presented the most iTn]:>ortant 
content n the ?as\ Basic Human Activities category (Overall Importance 
^ 8U.6). The textbook treatment of the content in the Present Basic Human 
Activities category also turned out to be most acceptable (Overall Accept- 
ability +52»3), ^^ile the treatment of Factors in the Natural Environment 
category was least acceptable (Overall Acceptability +31.U). By grade level, 
fifth grade textbooks scort J on the average most favorably on all accounts 
of Accuracy, Importance, and Acceptability* Although the textbooks on the 
average treated the topic of Hawaii, reasonably satisfactorily, it is clear, 
as mentioned aboya, that mapy of the individual" textbooks leave ample room 
for improvement* 

The number of .the original textbook recording units N^^ gleaned from 
the individual tcectbooks that were synthesized into a single questionnaire 
unit varied from case to case* The number of questionnaire units N for 
which J, original textbook recording units were synthesized are as follows: 

ERIC 
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II jl 2 3 h $ 6 7 8 

orj . 

j : 

N_ ! IIP 53 26 9 lU 11 9 11 

4 f 

9 10 11 12 13 m 15 16 
■ ■ j • , , 

j 5 3 6 6 0 2 3 2 

Total number of questionnaire units j ZI ^'q * 286 
Total number of textbook recording units: Nq N^^, » 950, 
Therefore, each of the questionnaire units was synthesized from as 
many as sixteen original textbook recording units* The number of question- 
naire "units, for each of which at least six original textbook recording 
units were synthesized, is fifty-eight, while on the average 3 -32 original 
textbook recording units were synthesized into a single questionnaire unit. 

In the process of synthesizing a number of original textbook recording 
units into a single synthesized questionnaire' unit, it was not always possible 
to include every single detail of the statements in the original textbook 
recording units* Consequently some degree of modification may have occurred 
in the process. The degree of modification varied, and became more pro«- 
nounced asf the number of original textbook recording units synthesized into 
single questionnaire units increased* 

In the process of synthesis, the chance of the modification in the 
direction of improving the original textbook recording Unit in accuracy (and 
possibly in importance as well) is equally probable as the chance that the 
direction reduced its original accuracy. "When all of the possible deviations 
in accuracy in the individual modification that arose in the process of 
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synthesis are added, the effects of the individual nodification would 
averat'e out, L'ivinc essentially insipnificant charipes in the textbook ap- 
praisal. ITiereforo the aporaisal of the individual textbook content by 
usinf; the Jury's appraisal of the aynthesized quostionnaire utiits appe3ars 
to give a reasonably [:ood appraisal of the individual textbook content. 
This process of averaging out the effects of the nodifications was also 
confirmed by the researcher by randomly selecting a few test cases • 
Quantitative Appraisal of the Textual Content Distribution VJithin the Sub - # 
categories . 

• It is essential that the amount of coverage of various aspects of a 

topic be proportionate to its relative inportance. Therefore, in order to 

evaluate the adequacy of the textual content distribution, the Jury members 

were also asked to rank the subcategories of the Basic Human Activities and 

Factors in the Natural Environment, in terms of their importance in pre- 

sentir^: Hawaii to elementary school children • The jury's ranking of the 

subcategories in the order of importance wais weighted from eight to zero 

for the subcategories in the Basic Human Activities, and from fourteen to 

zero for the subcategories in the Natural Environment. Because the weighted 

rank points were determined in an arbitrary ratio, in order to facilitate 

eiasy comparison, they were normalized , to determine the normalized ranking 

point "NRP", by using the formula: 

(Individual Total Subcategory 
Weighted Point) 

HHP « X 100 

(Total Weighted Point for the 
First Hanking Subcategories) 
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The NH? and the simple consecutive rankinp number of the subcatefories 
according to the lUiV are listed in Table IH. 
fteliability of the Jury^s itankinc of the SubcateL'ories 

The reliability of the simple consecutive ranking of the subcategories 
on the basis of the jury's rankin^:s discussed above, can be deterndtied by 
using the Kendall's Coefficient of Cone orrja nee V/, 

s 



where 



i 

H « k^ N (ri^ - 1) 
• 12 

Hj = Jury's rank total for the j-th subcategories 

k « IJumber of jury members 

N » Number of subcategories ranked 
'The Kendall's Coefficient of Concordance W for the jury's rankings 
of the Baeic Human Activities subcategories is 0#iU, while that of the 
Natural Environment is even sn^ller (0.2$). The relatively small Kendall's 

it- 

Coefficients of Concordance for both the Basic Uman Activities and the 
Natural Environment subcategories rankings are revealed in T-able III by 
the uneven spacings in the normalized ranking points among the subcate- 
gories • The effect of this uneven spacing is especially pronounced in the 
rankings of the subcategories for the case of Factors in the Natural Envi- 
ronment, where the ranking points overlap twice (in the ranks of ten and 
elev*»n)« 



!• Sidney Siegel, Monparametric Statistics for the Behavioral Science 
^ (New York: McGraw-Hill do-, 1^^6), pp. 22^^2^^. ' : 
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The relatively snail Koddall's Coefficients of ConcorcJanco indicate 
that the significance of the simple conseciitive rar.kinr rmrbers t;ivon in 
the first coluT'ins of Table III for the ijubcate^'ories ^vas reduced. Ihis 
can be seen, for exarnle, in the case of the Factors in the ^^atural iSnvi- 
ronment where the rank one and two* subcatef- oriels, regpectivoly, [possess 
100 and 98 for their nornalized ranking points. Because of the small dif- 
ference in the nornalized ranking points between the two neighboring ranks, 
a sli^'ht alt^^ration of the jury^s appraisal in the ranking can off sot the 
balance of the ranking points betx^een the two subcaterories, and therefore 
can even exchanpe their i^ankin^; order» 

However, one can note that the norTiiali7ed ranking points MP for the 
subcategories thenselves remain iraningful in the sense that they accurately 
represent the jury's consensus of the importance of the subcategories. 
Therefore, by using the nornali5:ed ranking points, instead of the simple 
consecutive ranking uunbers for the subcategories, a useful quantitative 
assessment of the textbook cont'=^nt distribution iriLthin the various subcate- 
gories can be obtained. 

Quantitative Appraisal of the Textual Content Distribution 

In order to make the quantitative appraisal of the distribution of 
the individual textbook content within the subcategories, by utilizing the 
normalized ranking points of the subcategories discussed above, the concept 
of the Distributive Coefficient D, for each individiaal textbook is intro- 
duced by: 



D ■ K 7 G 
where ' F • ^ ( 1 + 2 



K " .lormalization fact'or 

I « lOtal number of subcatCe ories 
s 

« Nunber of cubcatee^ories for vmich one or 
TiOre rocnrciing units are allotted by the 
textbook 

« Numbar of recording; unites allotted by the 
textbook for the i*th subcategories 

li^ « Normalized raakinc points for the i-th 

subcategories > 

The factor G favors. ,the distribution of the textual content to the 
more important subcategories, wriile the factor F favors the even coverage 
of all subcatep^ories by the textbook. Therefore, the factors F and G to- 
gether favor the inclusive textual content distribution in a proportionate 
rate according to the ir.portance of the subcategories as indicated by their 
normalized ranking points. The normalization factor K is introduced to 
facilitate easier comparison of the data. 

The properties of the Distributive Coefficient D discussed above, 
can be further explaifted by the following hypothetical examples • Consider 
the oases iihere six recording units are x.o be distributed in three subcate- 
gories, (a,b,c), for each of which the normalized ranking points are, 
respectively, 100, ?0, and 25 • Assume that the six recording units are 
distributed in the three subcategories (a,b,c) as in the cases of A, B, C, 
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L, and K shown below* Their rosnective F and G factors and the rosi^ltant 
Distributive Coefficient D can be dotenninod as t^i^'sn below: 



Sub- 
categories 


(ilor^nalizQd 
Hanking 
Points) 


A 




Cases 


it 


I'i 


a 




3 




T 
J. 


f \ 

u 


L 
0 


u 








•'j 


n 


u 


c 




1 


1 


3 


h 


c 


F 




1 


1 


1 


0,71 




0 




71 


63 


I46 


33 


ICX) 


K . 




l.hl 


l.U 


1.1^1 


l.U 


l.iil 


D 




100 




65 


36 


77 



Note that F is one for the cases of A, 3, and C, because the six recording 
units cover all subcategories • Hoa-zeverj F factor for the case L is Ot77 
because the six recording units cover only two out of three subcategories. 
The F factor for the case M is still smaller with 0«55 because all of the 
six recording units are concentrated in one subcategory. Therefore, F 
factor favors inclusive coverage of all subcategories by the textbook. 

On the other handj case A has the largest G factorj while case C has 
the smallest one among the cases Aj Bj and C« The reason can be easily 
understood by noting that case A allotted the recording units in close pro- 
portion to the normalized ranking points, while case C is inversely propor- 
tionate in its distribution of recording units. Therefore, case A did 
better in the distribution of its recording unitd than case C. The allotment 
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of the recording: units in the case of B is partly in a mixed order, and 
thus the 0 factor .^or the ca55e of 3 lies bciwcen the caries of A and 3» 
Tlie G factor for tho ca.^ie of 11 is lar^-e (G ■ lOO) by heavily conceni.ra- 
ting on the r^ortt important yubcate^orien, while th^* G factor for the case 
L is the smallC5it by heavily allotiag the recordiaij units in the less 
important uubcategories. The normalization factor L ic tiow introduced byi 

K - 100 

Larrest (FG) 

which in the eKar,.])le given above is l»Ul« 

The Distributive Coefficient is thus larger as the recording units 
are inclusively distributed amont; the subcategories in close proportion 
to the normalixied subcategory ranlcing points. The following examples 
illustrate the situation: 

Case A : .The recording units not only cover all the subcategories, 
but the recording units are also distributed in nearest 
possible proportion to the importance of the subcategories. 
The Distributive Coefficient D is, 100. 
Case M ; The distribution of the recording units recognized the most . 

important subcategory > out it failed to cover other subcate- 
gories. The Distributive Coefficient is considerably reduced 
to seventy-seven* 

Case L t The recording units not only fail to cover all the subcate- 
gories, but also are heavily concentrated in the less impor- 
tant subcategories. The Distributive Coefficient is thirty- 
six, which is quite small* 
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Usinp; the data of the fiiotribution of the recording units in the 
subcate^'ories, the resaarcher detertip ned the Distributive Coefficient U 
for each individual textbook. The results are sumarized below, where 
the number of textbooks that fall in a t'iven D range is indicatea* 



D Range 
Over 20 to 30, 
Over 30 to UO, 
Over UO to 50, 
Over 50 to 60, 



D Range 
Over kO to 50, 
Over 50 to 60, 
Vtver 60 to 70, 

The total number of textbooks here is less than 31, because some 
contain no recording units in the categorief . The Distributive CoeJffi** 
cients for the Basic Human Activities are generally better than those of 
the Factors in the Natural Environment • This study shows that many text- 
books fall short of satisfactory distribution of the textual contend* 

The Distributive Coefficient D was introduced in this study by a sim- 
ple formula* But the coefficient can be modified to give more accurate 



Basic Human Activities 



N\mber D Range Number 

1 Over 60 to 70, 5 

0 Over 70 to 80, 7 

0 Over 80 to 90, 7 

6 Over 90 to 100, U 

Natural iilnvironment 

!Iumber D Range Number 

3 Over 70 to 80, $ 

8 Over 80 to 90, $ 

3 Over 90 to 100, 3 
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iippMlsal of the toxUook content ^Jlatributlont tiwtvnvp note Uukt when 

the nunbf*r of rccordlaK unite oxonlned is larce^tho elm le fornula vsQd 

■ 

In thia 4;tucly can provide /lufrioiently tood mHaauremont of tliu 'il^trihu«.lon 
of the textual content* 

'H\'kUU:iU A.^ iUI3dL OF TilJi 

Sxariplee of textbooks pn^eentln^ v^O'lnt: deerees) or Inaccurato* 
accurate^ and unaeccjptable^acceptahle content are presf»ntod with comments 
nade by tho jurj* mer^hors* The Jury nembers in particular objected to the 
foUoninf two aspecta of the questionnaire units i 

1» The use of auporlative adjectives such as ••all'* or ♦•nost*' to 
describe facts or concepts on Hawaii^ when adjectives like 
"some* or "fow** would better describe reality* 
2* The oversimplification of facts which distorted the essential 

meanings of concepts on ii.wali* 
An example of a textbook's oversimplification and resultant die* 
tortion of Haiiaiian history is presented by th'' follovini; questionnaire 
unit* 

Sxa^le 1 A selfish king cuie to the throne of Hawaii* He built him- 
self a beautiful palace at great expense to his people* lie 
spent thouaanda of dollars on fancy clothes* He thought his 
word should be the law* He even wanted to bring back the 
tabus* All thia did not please his subjects* Some of them 
rebelled afainst him but the king was not overthrown* But 
he had to pive in to* some of the wishes of his people* Ahen 
he died, his sister became queen* 
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This questionnaire unit was a} f>ral£ieci an rolativcly inaccurate (-5c), 
rclati\8ly important (75), and relatl^''ely unacceptable (-61.2) by the 
Jury. The Jurors' connents werei 

Juror Onr ~ "Ilot 30 ainple as this." 

Juror Twc "I «up;-)Ose this is uing Kalakpua. This is a very 

slanted view." 
Juror Three — "Absolutely false I" 

The quantitative evaluation pointed out that the Past Pasic Hunan 
Activities catefury was the least accurately presented by the textbooks, 
but appraised by the jury as tfie most Importaat section. The following 
e^anples explicitly reveal the variance in different textbook^s version 
of how the United Statf^n ?^nnexnd Hawaii. 'Hie following; three uuestionnaire 
units are fro''. the subcatcfory, Or[*anizing and Qoverning, in the Past Basic 
ffucan Activities category. 

£xanrle 2 Queen Liliuokalani was the last royal ru^er- of the islands. 

She vras forced to nive up her throne b/ the Hav;aiian people 
wlio were tired of monarchs. 

The questionnaire unit was appraised by the Jury as highly inaccurate 

(-100), highly irporUnt (lOOj, and thus highly unacceptable (-100). The 

Jurors made the following comments 1 

Juror One ••Kostly pro-American annexationists, not the 

Hawaiian people. 

Juror Two — ^Haole (white men) minority was revolutionary. 

Hawaiians were certainly royalist*^ 
Juror Three — "She had to abdicate the throne because of sugar 

interests (American)*^ 
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Example 3 In 1R91 Queon Liliuokalani became rul«r of Hawaii, She did 
not like what was liaj poning in l^er country because there were 
inorc foreiEners than natives, and planters and businessmen 
had too much control. She announced that she w':uld rule Hawaii 
and there would be no nore constitutional or* representative 
government. 

Tlie questi-^nnairo unit was appraised by the jnry as moderat^:ly accurate 

(+$0), highly important (100), and moderately acceptable (+70.7) • One 

juror commented J 

Juror One — "IIo, she offered a new constitution J» 

Example h A fow vrhite men (mostly Americans) started a revolution 

which was a quiet one with practically no fif^htinp, because 
the captain of a United States warship had landed soldiers 
and marines to protect Anerican lives and r^ropfjrty. The 
revolutionists declared that Liliuokalani was no longer 
que en « 

This questionnaire unit was a[>nraised by the jury as highly accurate (+100), 
highly Important (lOO), and highly acceptable (+100) • 

From the exar.:jles provided above, one can readily see how the different 
textbooks' presentations on Hawaii vary in quality « The Hifference in the • 
treatment of Ha.v'aii by the various textbooks range from the highlj'" inaccurate 
to the highly accurate, and from the highly important, to the unimportant. 
Consequently, the content evaluations provided by this study^ can help child- 
. A*en studying Hawaii develop better understandings by using textbooks that 
provide the greatest amount of highly accurate and highly important content. 

The jury members who participated in this study were cooperative and 
comrriented extensively on the questionnaire items* . Their comments often 
reflected the hiph scholastic standards applied in appraising the questionnaire 



1. Bernadyn K. Suh, "An Analysis and ISvaluation of the Content on 
Hawaii in Selected Elementary School Social Studies Textbooks" (Unpublished 
Ed.D. dissertation, Columbia University, 1970) • 
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units. Some of the Jury members also made cements on the overall text- 
books' presontations on Hawaii* 
Juror One: 

"I an very doi^reysed by the sorene, uaconplicated, probably 
unconscious assuTii^tion that chan^^e is always for -iiu best, that 
Americans did it all here, that the only lulssionaries ^-fBve Protes- 
tant, kn^.] by the almost total orrission of material about Orientals, 
who rialce up the bulk of the [.)c. oulati on. Very [:>irtial view of thincst 
And isn't it tine kids vrere tau^'ht '>af5ic ecological conssidnrations, 
since v;e arc polluting oursrlve- out of exist^^nce?" 

Juror T\>ro: 

"I an plea red to ,see that soneone is examinioK the wishy-washy, 
risii-majh of taisinfornation which, from this 'janple, is the diet to 
which school children are sunjected on the nature of Hawaii • It is 
tine it was looked at, exposed and hopefnll^'- corrected* Good Lucki" 

Juror Three: 

"This is a topic worthy of researoh. It is appalling to note 

the 3ii'i;listi^: ap[jroach to v/ritinj- for criildren produces such horrible 

material. I lefran to wonder if hintory is a worthy studj for the young." 

Juror Four: 

"• • • as a v.Titer for teena^:ers during the past forty years, 
I know how difficult it is to express complicated ideas in simple 
lan{':uage. Therefore I have freat sympathy for those who do publish, 
even though at times their errors are glaring*" 



Innovative methods of content analysis and eva^luation of elementary- 
school social studies textbook presentations were developed and applied 
to the subject of Hawaii^ to attain the widest scope of appraisal possible. 
The textual content was identified, and categorized, to be synthesized into 
a questionnaire • Based on the appraisal of the questionnaire by a jury of 
eminent scholars on Ha>;aii, the textual content vms quantitatively evalu- 
ated for its accuracy, importance, and acceptability. 
O 
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The distribTitive coefficient was introduced to detornine whather 
appropriate distribution of the textual content \;as nade in the ::iubcate- 
gories in proportion to their iruportance as rauKod by the jury. Xho riajor 
findings in this studj'- vrerc the following: 

1. 3y conpnring various pf^rcenliaije indicators rslatinr 'law^iii to the 
entire Unltca L)tatei3j it apueareu that the selected elementary 
social studies textbooksj in ^:eneral, ^'ave vsatisfactory att^intion 
to the topic !Iav:'iii« 

2« The evaluation of the questionnaire as a v::iOle revealed that the 
textual content in the Present Basic Human Activities V7as most 
accurately treated (+5Ui7)> while the Pa^jt Basic ifunan Activities 
was treated least accurately (+26.6) • Greater success was achieved, 
on the other hand, in presenting important content on the Past Basic 
Activities (7^»8), while the treatment of Natural Environment was 
least favorable (60»l) in importance . 

The findings also indicate tnat the treatment of the Present 
Basic Human Activities was most acceptable (+50«0) while the treat- 
ment of Past Basic Hunan Activities was least acceptable (t28«0)» 

3» The evaluation of the individual textbooks reveals that on the 
avera^^e/ the textbooks treated the Present Basic Human Activities 
content most accurately {^$^.\x). The toxtbcoks achieved on the 
average greater success in presenting iMportant content on the Past 
Basic Human Activities (8U#6) while the textual content on the Pre- 
sent Basic Human Activities was found to be most acceptable (+52»3), 
However, the content on the Natural Environment, on the average, 
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failed most on all accounts of accuracy (+30.6), imi^'OKance (62*0) 
and acceptability (+31*a)« 

By crade the fifth fjrade textbooks scored, on the aver- 

i^C^i nost favorably on all accoimts of accuracy (+U3*0), inportance 
(76,0) and acceptability (+l43t7). 

In ^feneral, the textbooks treated the topic of Mawaii reasonably 
satisfactorily, however, f re it variance exists among tlie individual 
textbooks. The selected elementary social studies textbooks pre- 
sented in overall averages: a) noderatoly accurate tr?:atment 
(+37«0), b) fairly successful inclusion of the imjortant textual 
content (7u.$), and c) moderately acceptable coverage ('«-37.6) on 
Hawaii • 

The Distributive Coefficient D evaluation for the individual te:<t- 
book revealed that many textbooks failed to nake satisfactory 
distribution of the textual content in proportion to the iiuportance 
of the t3Ubcate[;orio3. 
The results of the individual textbook evaluation can help teachers 
and curricirlum developers decide, both quantitatively and qualitatively, 
which textbook is preferable in such aspects as: the amount of coverage, 
accuracy, distribution of content, and ira|)ortance of content. 3y knowing 
the relative importance of the subcategories, one can also stress the 
coverage of important subcategories and de-enphasize the less important 
ones* 

Trie foUowinc specific recoknendations for changes in the textual 
content presentations on Hawaii are made: 
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!• The textual content on ^Waii is often too simplified, and dis- 
torted views of Ilav/aii are presented to the 3tudent5?» Essential 
infomiation should be presented accuratelyj and should not be 
distorted through sin^;jlificatioru 

2» The textbooks as a group prorented riore consent on Old Hawaii and 
DHiphasized the contributions of vestcrn civilisation to Hav^aii 
culture* For example, most books talk about the contributions 
Of the missionaires who developed the Hawaiian alphabet and the 
first written Hai^Taiian laa^;ua£e» clowever, little reference is 
made to the deterioration of the - lives of the ilawaiians because 
of the impact of western civilization* 

3» Generally, too much emphasis was placed by the textbooks on the 
two m&*jor crops of Hawaii, pineapples and su^ar cane» and not 
sufficient enphasis was placed on the people of Hawaii* 

h* Often the racial composition of Hawaii was presented in an unreal- 
istic manner, where everybody lives together peacefully and happily, 
unaiirare of racial differences. The textbooks should present a 
realistic view of the racial situation in Hawaiij prejudice does 
exist and should not be ignored* 

5* Too often, the textbook presentations sounded like travel adver- 
tisements, i-Aiich focused on the scenery and typical tourist sites. 
Instead, most emphasis should be placed on the real lives of modern 
liawaiians, who have to cope with the problems of pollution, traffic 
jams, and other problems of living in a technological urban society. 

6« Most textbooks mention Japan's attadk on Pearl Harbor which caused 
the United States' entry into Worid War II • However, not a single 
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textbook examined mentioned the contributions of the Hawaiians 
of Japanese ancestry who fought bravely in Europe and emer^red as 
the most decorated f^roup of soldiers in tho history of the United 
States Army 4 

The textbooks should emphasize the fact that in Hawaii, Americans 
of racial minorities can participate fully in the American v;ay of 
life^ Host stress should boon the daily lives of Hav/ailans as they 
interact in a deriocratic society. And less emphasis should be 
placed on the different products of Havraii, various places o^ Intcre 
and bizarre aspects of life in Old Hawaii • 
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AVIiP.iGii: llillGBillD pours OF -^UioTlCv' LiIILi ;.'.4IT3 IN IkJd'.i CATIiaOiiI;iiS 
(A) JUKY'S AlP:iAl:,.a 



llajor Categories 


Accuracy 


Importance 


Acceptability 


Natural 

Environment 


+i40.0 


60.1 


+35.2 


Basic Human 
Activities 


Past 


+26.6 




+26.0 


Prespnt 




67.6 


+50*0 


Past + 
Present 


+37.5 


72.5 


+36.6 


Total 


+38.5 


68.1 


+36.2 



(3) IIJ\'3STIGAT0ii'3 APPRAISAL 





Major Categories 


Accuracy 


Importance 


Acceptability 




Natural 

Environment 




60.5 


+27.1i 




Basic Human 
Activities 




Fast 


+39.8 


72.1 


+36.0 




Present 


+59.0 


. ^3.0 


+U7.5 




Past + 
Present 


+1^7.3 


68.6 


+1*0.5 


ERLCTotal , 

L...., , ^ ^^^^^ ^ ^^^^^ ^^ 


♦1*5.5 


65.9 


*36,0 



TABLE II 



AVERAGE VBIGHTBD POINTS OP THE TBCTBOOKS POR EACH GRADE 



Grad« 


Fourth 


Fifth 


Sixth 


Mixed 


Overall 


Accuracy : 


Natural 
Environment 


+23.1 


+32.6 


+31.6 


+35.7 


+».6 




Past 


+15.7 


+40.2 


+29.2 


+11.7 


+33.2 


Human 
ties 


Present 


+57.5 


+60.6 


+22.8 


+58.4 


+55.4 


o > 
m ii 


Past + 
Prwent 


+40.5 


+50.0 


+25.5 


+37.2 


-f44.5 


Total 


+30.6 


+43.0 


+20.8 


+36.7 


+37.0 



Importance: 



Natural 
Environment 


58.5 


64.0 


57.2 


65.2 


62.0 




Patt 


75.2 


86.4 


91.8 


84.2 


84.6 


1 8 

IS 


Present 


72.2 


76.1 


71.5 


70.9 


74.2 


m u 


Past + 
Present 


75.3 


81.4 


82.4 


72.3 


79.5 


Total 


72.9 


76.0 


71.0 


72.1 


74.5 



Acc^tablllty: 





Natural 
Bhvlronment 


+29.6 


+32.6 


+26.0 


+35.6 . 


+31.4 


• • 


L 


Past 


+17.8 


+40.8 


+36.1 


+ 9.6 


+34.6 




il 


Present 


m.7 


+57.8 


+15.8 


+63.6 


+52.3 


EM 


Pest + 

PrMMt 


+3ft.3 


+^9,3 


+25.8 


+39.9 


+43.8 




^ ■ :J 
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TABLE III 



Basic }\ViV\an Activ, 
Subcategories 


Kank 




Producing, lixcht^ncing, 
Distributing, and Con- 
suming Food, Clothing, 
etc* 


1 


100 


i'rotecting and Con- 
serving HuToan and Nat- 
ural iie sources and 
Proporty 


2 




Organizing and 
Governing 


3 


93 


Providing Education 


h 


70 


Creating Tools, Tech-^ 
nics, and Social Ar- 
rangements 






Communicating Ideas 
and Feelings 


6 


5U 


Transporting People 
and Goods 


7 




iixpressing and Satis- 
fying Aesthetic and 
Spiritual Iinpuises 


8 




Providing Recreation 


9 


18 



:/atup» linviron» 

Subcatef'Ories 


liank 


URP 


Space or Area 


1 


100 


Oceans 


2 


98 


uxooai 
Position 


3 


91 


Land Forms 


U 


83 


Soils 




77 


Natural 
Vegetation 
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